A Novel Adaptive Distributed Load Balancing Strategy for Cluster

نویسندگان

  • Hai Jin
  • Bin Cheng
  • Shengli Li
چکیده

* This paper is supported by National 863 Hi-Tech R&D Project under grant No.2002AA1Z2102 Abstract with the dramatically increasing of users accessing Internet services, many researchers employed cluster server to provide their Internet services and proposed all kinds of scheduling strategies to address the imbalance among real servers. However, most of them are based on TCP connections and pay little attention to the diversity of requests and real servers. Thus these strategies will lead to serious imbalance if deployed in a heterogeneous cluster. In this paper, we propose a novel adaptive distributed load balancing strategy, called ADLB, to address this problem. Different from the existing solutions, it offers a kind of least delay scheduling method, which implements adaptive scheduling strategy by the TCP-SYN packet delay mechanism and doesn’t require any additional communication among real servers and front-end dispatcher participation. Experimental results show that our technologies can achieve better balance for heterogeneous cluster and provide good scalability.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Adaptive Dynamic Data Placement Algorithm for Hadoop in Heterogeneous Environments

Hadoop MapReduce framework is an important distributed processing model for large-scale data intensive applications. The current Hadoop and the existing Hadoop distributed file system’s rack-aware data placement strategy in MapReduce in the homogeneous Hadoop cluster assume that each node in a cluster has the same computing capacity and a same workload is assigned to each node. Default Hadoop d...

متن کامل

Task Partitioning and Load Balancing Strategy for Matrix Applications on Distributed System

In this paper, we present a load-balancing strategy (Adaptive Load Balancing strategy) for data parallel applications to balance the work load effectively on a distributed system. We study its impact on computation-hungry matrix multiplication application. The ALB strategy enhances the performance with features such as intelligent node selection, pre-task assignment, adaptive task sizing and bu...

متن کامل

Adaptive Load Balancing Policy for Web Server Custer

The paper highlights the significance of open source software for distributed computing environment and proposes an adaptive load balancing model using open source software for distributed computing environment. The load balancing strategies used by the model are based on load of the system. The proposed algorithm uses current load, response ratio and processor utilization of the nodes of the w...

متن کامل

FlexSplit: A Workload-Aware, Adaptive Load Balancing Strategy for Media Cluster

A number of technology and workload trends motivate us to consider a new request distribution and load balancing strategy for streaming media cluster. First, in emerging media workloads, a significant portion of the content is short and encoded at low bit rates. Additionally, media workloads display a strong temporal and spatial locality. This makes modern servers with gigabytes of main memory ...

متن کامل

COMET: A communication-efficient load balancing strategy for multi-agent cluster computing

—This paper proposes a new load balancing strategy, called Comet, for fast multi-agent cluster computing. We use a new load index that takes into account the cost of inter-agent communications. Agents with predictable workload are assigned statically to cluster nodes, whereas agents with unpredictable workload are allowed to migrate dynamically between cluster nodes using a creditbased load bal...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2005